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FIELD OF THE INVENTION 



The present invention relates in general to an infrared video camera system for use 
in thermographic inspection of equipment and for generating reports based thereon. In 
particular, the present invention provides a method and apparatus for storing a plurality of 
10 thermal images relating to a thermographic survey and for associating a barcode generated 
data field with a thermal image. 



a cooled or uncooled Charged Coupled Device (CCD) focal plane array, pyroelectric 
detector or the like, have been employed in infrared thermography systems for performing 
thermographic inspections or surveys of large numbers of elements. Thermographic 
images of an element may then be compared with a control image or other previously 

20 recorded thermographic image of the same scene or element. Such systems may be 

employed, e.g., in industrial facilities for plant maintenance, or the like, in which failures 
of electro-mechanical equipment, process equipment or other devices may be predicted 
based on abnormalities or "thermal events" detected in a live or recorded thermal image of 
the device being surveyed. Such thermographic surveys may also be employed in 

25 agricultural, medical, veterinary medical, law enforcement and military applications. In 
such applications, a thcrmographer may prepare a thermographic survey comprising a list 



BACKGROUND OF THE INVENTION 



15 



Recent infrared (IR) video camera systems employing IR sensitive elements, e.g., 
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of devices, objects or infrared scenes, called elements, to be recorded or surveyed. Each 
element is then periodically recorded using a thermographic video camera to record thermal 
video images of the elements of the survey. Thereafter, each video image of an element of 
the survey may be reviewed for comparison with a previously recorded control image of 
5 the element. By comparing the survey image with the control image, a thermal abnormality 
or thermal event may be detected. Such a thermal event may indicate a pending failure of 
the element. One such thermographic inspection system is disclosed by Piety et al. in U.S. 
patent No. 5,386,117. 

Piety et al. disclose a mobile thermography system comprising an infrared camera, 

10 an ordinary visible image video camera, a personal computer, (PC), including an internal 
digital memory and a disk drive for digital data storage, a video recorder for recording 
analog video data, an LCD touch screen display device, a pen digitizer, various power 
storage devices, a system controller for operating various software which may be used to 
control and communicate between the various system elements, as well as, various other 

15 measuring devices, all mounted onto a mobile unit for ease of movement through a facility 
to be surveyed. Piety et al. also disclose a fixed base station computer including a digital 
data processor, for operating various digital data processing programs and including a 
video display and a printer for viewing video images, a memory, a disk drive, for digital 
data storage, an analog video recorder and analog video image processing equipment. In 

20 this case the mobile unit may be connected via conmiunication ports with the base station 
computer at the beginning and end of each survey so that digital and or analog images, as 
well as, image identifying data may be communicated from the base unit to the mobile unit 
or from the mobile unit to the base unit as required. 

According to Piety et al. software running on the base station computer is used to 

25 set up a framework of the thermographic survey. Such information as an element 

identifying name or control image, the type of element being surveyed, how to survey the 



2 



element, fault types to look for, templates, notes, fonns and the like are uploaded from the 
base station computer to the mobile unit prior to starting a survey to prompt the 
thermographic surveyor through the survey element by element and to record all 
information needed to generate a final report in the event a fault is discovered. After data 

5 collection is completed, the mobile unit is again connected to the base station computer and 
the collected survey images as well as other data which may have been entered by an 
operator during the survey are downloaded from the mobile unit to the base station 
computer for analysis and report generation. 

One problem with this approach is that the thermographic surveyor is prompted 

10 through the thermographic survey in the predetermined order according to a survey route 
which is established by the original thermographic survey framework set up at the base 
station computer. In cases where the surveyor may wish to change the order or the route of 
the survey, the prompt information must be scrolled through in order to find the identifying 
information associated with a desired survey element Since the survey may include many 

15 hundreds of images, this presents a problem to the surveyor when the order of the survey 
is changed. Another problem with the prior art approach is that many of the survey 
elements may be nearly identical, e.g. an electrical switch panel may contain tens or 
hundreds of substantially identical switches to be surveyed. In this case, an operator may 
confuse one switch with another. Even the element identifying information stored by the 

20 mobile unit may be confusing since element names and element control images may be very 
similar. For these reasons, an operator could easily loose the sequence of the survey 
thereby falsely identifying subsequent recordings. 

A further disadvantage associated with the prior art is that occasionally a re-survey 
may be required to confirm or reevaluate a thermal event for one or a portion of the 

25 elements of the survey. By the prior art methods, a surveyor would be forced to scroll 

through the entire survey to reach the data associated with the element or elements to be re- 
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surveyed. 

SUMMARY OF THE INVENTION 

5 The present invention obviates the disadvantages associated with the use of a route 

based or predetermined videographic survey sequence or with the need to sequentially 
scroll through survey element data stored on a video camera used for a video survey or data 
collection with a video camera system by providing a barcode label associated with an 
element to be surveyed and a barcode scanner associated with the video camera system and 

10 by storing identifying information associated with each element of the survey in an 
electronic memory associated with the video camera system. 

Generally, the present invention provides an integrated video camera system for 
capturing a video image of an element. The camera system includes a digital data processor 
and a memory module in communication with the digital data processor for storing program 

15 steps and for storing digital data in data fields provided on the memory module. According 
to the present invention, a barcode including a bar pattern representative of an identifying 
name of the element is associated with the element and a barcode scanner, in 
communication with the digital data processor, is used to scan the barcode. The barcode 
scanner generates an electrical signal in response to scanning the barcode and the electrical 

20 signal is interpreted by the digital data processor to associate the identifying name of the 
element with an appropriate data field provided on the memory module. When a video 
image of the element is captured, the video image of the element is stored onto the memory 
module with the identifying name of the element associated therewith. The memory 
module may also include a first data field having the identifying name of the element stored 

25 therein and a second data field associated with the first data field for storing a video image 
of the element. 
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In order for an operator to view a video image of an element, the integrated video 
camera system may further comprise a video display device in conununication with the 
digital data processor for viewing the video image of the element and for viewing the 
identifying name of the element A keypad in communication with the digital data 

5 processor may also be included for providing an operator interface to the video camera 
system so that the operator may give conraiands to the camera, e.g. for scrolling between 
video images, or the like. The memory module may be formed by having an internal 
memory associated with the video camera system, e.g. a read only memory, (ROM), for 
storing the program steps and a separate removable memory module, e.g. a PCMCIA card 

10 installed in a PCMCIA slot on the video camera system, for storing the digital data relating 
to the element in data fields provided on the removable portion of the memory module. 

The integrated video camera system may also be used for capturing a plurality video 
images of a plurality of elements included in a videographic survey. In this case, each of 
the plurality of elements has a unique identifying name and the memory module includes a 

15 plurality of data fields relating to each of the plurality of elements such that a separate data 
field is provided for storing each of the identifying names of the plurality of elements. In 
this case a barcode is provided associated with each of the plurality of elements such that 
upon scanning one of the bar-codes the electrical signal generated by the barcode scanner is 
interpreted by the digital data processor to associate the identifying name of the element 

20 associated with the barcode with an appropriate data field provided on the memory module. 
A video image of the element associated with the barcode is stored onto the memory 
module with the identifying name scanned from the one barcode associated therewith. In 
addition, upon scanning a barcode, the identifying name of the element associated with the 
barcode is determined by the data processor and a display screen having data fields relating 

25 to the element associated with the barcode may be displayed on the video display device. 

Also according to the present invention there is provided a method for capturing a video 
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image of an element with a video camera system which includes a digital data processor for 
executing program steps, a memory module in conmiunication with the digital data 
processor for storing the program steps and for storing digital data in data fields and a 
barcode scanner in conmiunication with the digital data processor. The method comprises 

5 the steps of, associating a barcode comprising a bar pattern representative of an identifying 
name of an element with the element, scanning the barcode with the barcode scanner 
thereby generating an electrical signal in response to scanning the barcode and interpreting 
the electrical signal according to the program steps to associate the identifying name of the 
element scanned from the bar pattern with an appropriate data field provided on the memory 

10 module. The method further includes the steps of capturing a video image of the element 
and storing the video image of the element onto the memory module in an image data field 
having the identifying name of the element associated therewith. The method may further 
include the steps of establishing a plurality of digital data fields on the memory module for 
storing digital data associated with the element, storing the identifying name of the element 

15 in one of the plurality of data fields and associating the identifying name of the element with 
all of the other of the plurality of digital data fields. 

An operator may retrieve the image data field and the identifying name data field of the 
element from the memory and display a video image of the element and the identifying 
name of the element on a video display device associated with the video camera system. In 

20 some cases the video camera system may determine a plurality of parameters relating to the 
step of capturing the video image of the element and store the plurality of parameters in the 
plurality of data fields established on the memory module and associated with the 
identifying name of the element. 

The method may also include the steps of storing the program steps in an internal 

25 memory associated with the video camera system while the step of storing the video image 
of the element on the memory module stores the video image onto a removable memory 
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module, e.g. a PCMQA card which is removable from the video camera system. 

The method may also be used for capturing a plurality of video images of a plurality of 
elements included in a videographic survey in which case the steps include, associating a 
plurality of bar-codes with the plurality elements, each of the plurality of bar-codes having 
5 a bar pattern representative of the identifying name of the element associated with the 

barcode, scanning a first barcode associated with a first of the plurality of elements with the 
barcode scanner thereby generating an electrical signal in response to scanning the first 
barcode; and, interpreting the electrical signal to determine the identifying name scanned 
from the bar pattern of the first barcode to associate the identifying name of the first element 
10 with an appropriate data field on the memory module. As above, the method includes 
y capturing a video image of the first element and storing the video image of the first element 

onto the memory module in an image data field having the identifying name of the first 
^5 element associated therewith. In this case, further steps include establishing a plurality of 

digital data fields on the memory module for storing digital data associated with each of the 
= 15 plurality of elements of the survey, storing the identifying name of each of the plurality of 
rU elements of the survey in separate data fields of the plurality of data fields and associating 
U the identifying name of each of the plurality of elements of the survey with a portion of the 
plurality of digital data fields such that each of the plurality of elements includes a plurality 
of data fields associated with the identifying name of the element. The method further 
20 includes the steps of retrieving the image data field having the identifying name of the first 
element associated therewith and displaying the video image of the first element and the 
identifying name of the first element on a video display device associated with the video 
camera system. 

According to the present invention, there is also included a method for performing a 
25 videographic survey of a plurality of elements. The steps include preparing a videographic 
survey database on a base computer such that the videographic survey database includes a 
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plurality of data fields for storing data associated with each of the plurality of elements. 
The database includes one data field for storing an identifying name for each of the plurality 
of elements and a data field for storing a video image of each of the plurality of elements 
and the data fields for storing the identifying name are each associated with an appropriate 
5 data field for storing a video image of each elements of the survey. 

The base computer also includes a program for generating each of the identifying names 
in a barcode format. After establishing the database on the base computer the method 
includes the steps of transferring the data fields to a memory module associated with a 
video camera system and associating a plurality of bar-codes, one barcode with each of the 
10 plurality of elements. The base computer may also include a barcode label printer 

associated therewith for printing barcode patterns onto labels for associating a label with 
' Z' each of the plurality of elements of the survey. 

^2 Each of the plurality of bai^codes includes a bar pattern representative of the identifying 

name of the element associated with the barcode. According to the method, an operator 
^ 15 scans a first of the plurality of bar-codes with a barcode scanner in communication with the 
ni video camera system to determine the identifying name of the element associated with the 
U first barcode. The digital data processor associated with the camera system interprets the 
3 barcode signal to determine the identifying name of the element and then selects the 

appropriate data field of the database for storing a video image of the element associated 
20 with the first barcode. An operator may then capture a video image of the element 
associated with the first barcode with the video camera system and the digital data 
processor stores the video image of the element in the appropriate data field of the database 



To complete the video survey, the method further includes the steps of scanning the 
25 remaining of the plurality of bar-codes with the barcode scanner, selecting the appropriate 
data field of the database for storing a video image of the remaining of the plurality of 




elements associated with the remaining of the plurality of bar-codes and capturing a video 
image of each of the remaining of the plurality of elements of the videographic survey and 
storing the video image of each of the remaining of the plurality of elements of the survey 
in the appropriate data field of the database such that the identifying name of the remaining 
5 of the plurality of elements is associated with the video image of remaining of the plurality 
of elements. 

In the final steps of the method, the data fields stored on the memory module of the 
video camera system are transferred back to the base computer which may be used to 
analyze the videographic survey data using programs stored on the base computer or to 
10 store an archive of the videographic survey data onto a memory associated with the base 
computer using programs stored on the base computer. In addition, an operator may 
choose to scan less than the remaining of the plurality of bar-codes with the barcode 
scanner. 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 

The features of the present invention will best be understood from a detailed 
description of the invention and a preferred embodiment thereof selected for the purposes 
of illustration and shown in the accompanying drawing in which: 

HG. 1 A illustrates a video camera system in accordance with a preferred 
20 embodiment of the present invention; 

FIG. IB illustrates another embodiment of a video camera system in accordance 
with a preferred embodiment of the present invention; 

FIG. 2 illustrates a schematic overview of a video camera system in accordance 
with a preferred embodiment of the present invention; 
25 FIG. 3A illustrates a single survey element display screen in accordance with a 

preferred embodiment of the present invention; 
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FIG. 3B illustrates a thumbnail display screen in accordance with a preferred 
embodiment of the present invention. 

FIG. 4A illustrates a barcode scanner in accordance with a preferred embodiment of 
the present invention. 

5 FIG. 4B illustrates a barcode label in accordance with a preferred embodiment of 

the present invention. 

FIG.5A illustrates a video camera system connected to a base computer system in 
accordance with a preferred embodiment of the present invention. 

FIG. 5B illustrates a schematic overview of a base computer system according to a 
10 preferred embodiment of the present invention. 

FIG. 6A illustrates a graphical user interface screen shot displayed by the base 
computer system according to a preferred embodiment of the present invention. 

FIG. 68 illustrates an other embodiment of a graphical user interface screen shot 
displayed by the base computer system according to a preferred embodiment of the present 
15 invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring now specifically to FIGS. lA and IB, there is illustrated an integrated 
infrared video camera system 10 for use in collecting thermographic survey data in 

20 accordance with a preferred embodiment of the present invention. The infrared camera 
system 10 generally includes a camera body 12, for housing a video camera image 
capturing system, a keypad or data entry device 14, for providing an operator interface to 
the infrared camera 10, and a color or gray scale video display device 16, which may be 
incorporated within the camera body and viewable through a viewfinder eyepiece 18, or, 

25 which may be optionally connected to the camera 10 via a separate display device port 20 
by an appropriate interface connector 22. The display device 16 may comprise a liquid 
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crystal display, (LCD), a cathode ray tube, (CRT), or any other display device for viewing 
thermal or other video images in real time, and/or for scrolling through and reviewing 
previously captured or stored thermal or other video images . 

The camera 10 also includes a removable memory module 30 such as a PCMCIA 
5 memory card which installs into a memory module port 32 for communicating with the 
camera 10, Other removable or non-removable memory modules may also be used such as 
a disk drive, tape drive, or other magnetic memory component, or a recordable compact 
disk memory, CD, or other optical memory device, or other suitable internal or external 
electronic digital data storage devices or analog memory devices, such as a video cassette 

10 recorder, may be provided to store thermal images captured by the infrared camera 10. 

The camera 10 also includes an imaging lens assembly 34 for relaying an image of a 
scene onto an imaging sensor for capturing an electronic image of the scene. The imaging 
lens assembly 34 may be interchangeable with other imaging lens assemblies having 
different optical properties, e.g. field of view or magnification . The lens assembly 34 may 

15 also include an optical filter, (not shown), for filtering out unwanted wavelengths emitted 
by the scene. The camera 10 may also include one or more input/output, (I/O), ports 26 for 
connecting other devices to the camera 10 such as a base computer, (PC), a portable 
computer or laptop, a printer, fax, or other communication device, an optical or thermal 
measurement instrument, diagnostic equipment, additional data storage devices, other 

20 display or data entry devices, an audio microphone, audio headphones or any other device 
which may aid the thermographer in capturing survey data. 

Depicted schematically in Figure 2, the camera 10 also includes an infrared sensor 
assembly 36, such as a cooled or uncooled focal plane array, e.g. a charged coupled device 
array, (CCD), or pyroelectric detector or array, or the like, for providing an electrical signal 

25 in response to receiving thermal radiation emitted by a scene under analysis thereon. Of 
course, other types of infrared sensors or scanners may also be used to detect the thermal 
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profile of a scene without departing from the intended scope of the present invention. The 
sensor assembly 36 may also have sensitivity at the visible wavelengths so that a visible 
image of survey elements may also be captured. Additionally, more than one sensor 
assembly 36 may be employed such that an optical image from the lens 34 may be 

5 redirected by a mirror, or the like, to a second sensor assembly so that infrared and visible 
image data could be captured by different sensors installed in the same camera system 10. 
Alternatively, a separate visible image capture device may also interface with I/O ports 26 
so that digital visible images may be captured by the separate visible wavelength video 
camera device and conununicated to the camera 10 for storage on the memory module 30. 

10 The analog output of the infrared sensor assembly 36 is converted into digital image 

data by an analog to digital, (A/D), converter 38. Thereafter, the digital image data 
produced by the A/D converter is directed into an equalization processor 40, which applies 
a pixel to pixel correction to the digital image data in a manner known in the art. The 
corrected digital image data is subsequently stored in a frame buffer 42. This same 

15 corrected digital image data may also be stored on the removable memory module 30. The 
digital image data is output from the frame buffer 42, mapped by a mapper 44 and scaled 
by a scaler 46, as necessary for displaying the corrected digital image of the scene, again in 
a manner known in the art, onto display device 16 of the infrared camera system 10. In 
addition, the corrected digital thermal image data and other information (see below) 

20 displayed on the display device 16 may be stored in the memory module 30 or in another 
storage device associated with the infrared camera 10 for immediate viewing, for later 
analysis or for archival purposes. 

A microprocessor 48 controls the operation of the infrared camera 10 and the 
display device 16 in response to programmed instructions stored in an internal digital 

25 memory 50, e.g. a read only memory, (ROM), or programmable or flash memory or the 
like, and in response to operator commands input via the keypad 14. The microprocessor 
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48 may also process programmed instructions for displaying text and other graphic 
symbols onto the display device 16 such that text data fields may be displayed 
simultaneously with a video image or exclusively text and graphic images may be displayed 
on the display device 16. Such progranmied instructions as well as data associated with 
5 survey elements may reside on the memory 50 or the memory module 30 or on another 

interconnected memory device such that the microprocessor 48 interacts with a memory and 
with keypad 14 to receive input instructions from an operator, receive data an<^r 
progranmiing instructions from the memory 30 or 50 and drive the display device 16 such 
that video images, text data fields and other graphical images are displayed to the operator. 
10 Camera display screen views are illustrated in FIGS. 3A and 3B. In FIG. 3A a 

H single survey element screen 300 is displayed. An image display area 302 displays a live 
or captured thermographic or visible image of the survey element An information panel 
^1 304 displays data fields relating to the image display area 302, e.g. a recording date and 
time are constantly displayed in a data fields 3 14 and 3 16, an object emmissivity in field 
= 15 3 18, a camera mode in field 330, a temperature of a selected point of the image area 302 in 
ry field 332 and a range of temperatures of the scene displayed in area 302 which is displayed 
U graphically by range indicators 306 and 308. An element identifying field 3 10 is displayed 
in a scrolling information window 3 12. Field 3 10 contains a unique identifying name, 
number or other identifying feature associated with the survey element. The identifying 
20 name displayed in field 3 10 is also associated with previously recorded images andor data 
sets which relate to the particular survey element being viewed in the image area 302. Such 
previously recorded images and data which may be stored on the memory mode 30 or on a 
base computer which will be described below. 

As illustrated in FIG. 3B, a thumbnail screen display 320 includes an image display 
25 area 322 which displays 16 thumbnail images 324. In this case one of the thumbnail 

images 324 is highlighted by an outline 326 surrounding the thumbnail image 324. A set 
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of image data relating to the highlighted thumbnail image 324 is displayed by an ^ 
information panel 328 which may include the same image information as is displajj^m the 
information panel 304, detailed above, but which may also include a RECALL button 334 
for selecting the highlighted thumbnail image 324 and viewing the highlighted image 324 in 
the single image view format of the above described display screen 300. An operator may 
scroll through the thumbnail images 324 using the keypad 14 which scrolls the highlight 
outline 326 from one image to the next while also refreshing the information panel 328 with 
the data associated with the highlighted thumbnail image 324. 

Since a thermographic survey may include many more than 16 survey elements, 
once a first set of 16 thumbnails images has been scrolled through, a new set of the next 16 
thumbnail images 324 is automatically loaded into the thumbnail display screen 320. In 
this case, a reference image, a visible image or no image but just the information panel 328 
associated with each element of the survey may have been loaded onto the memory module 
30 such that between 10 and 300 images are typically stored on the camera system 10 
during a survey. Furthermore the operator may be required to identify 10 to 300 survey 
elements, match each survey element with a thumbnail imageji stored on the camera 10 and 
capture a new thermal image of the survey element. Since the thumbnail images are small 
and since many survey elements may look similar, an operator could easily associate a 
wrong thumbnail image with the survey element. 

The camera 10 further includes a barcode scanning device, referred to generally by 
reference numeral 52 and connected to the camera 10 via one of the 1/0 ports 26 by a 
connecting wire 56. Such a barcode scanning device 52, shown in FIG. 4A, is weU 
known in the art and may comprise a hand held casing 54, an illuminating light source 58, 
such as a light emitting diode, (LED), or the like, which receives power from the camera 10 
via connecting wire 56 and is controlled by a barcode reader program stored in a memory 
50 associated with the microprocessor 48. 
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The barcode scanner 52 also includes a light sensitive detector or sensor 60 for 
providing an electrical signal in response to illuniination falling thereon. Connecting wire 
56 may also provide a voltage and or biasing current to the sensor 60 and communicates an 
electrical signal generated by the sensor 60 to the microprocessor 48 for analysis. A lens 
62 may also be provided for focusing light from the illuminating light 58 onto a barcode 
label 64 and for collecting light reflected by the barcode label 64 and directing the reflected 
light from the barcode label onto the sensor 60, A barcode 66 recorded onto the barcode 
label 64 may include a plurality of bar patterns each representing an alpha-numeric 
character, or the like, as is well known. 

Such a barcode label 64 which includes a barcode 66 may be attached to the survey 
element or otherwise associated with the survey elements. H^his case, the barcode 66 
represents a unique element identifying name such as the same name displayed in the 
display field 3 10 of the display screen 300 and 302. 

In this way, an operator may scan a barcode 66 printed on a barcode label 64, 
which is attached to or otherwise associated with a survey element to be surveyed or 
recorded, by passing the hand held barcode scanner 52 over the barcode 66. As the 
barcode 66 is scanned, a series of electrical signals generated by the sensor 60 are 
communicated to the microprocessor 48 which interprets the electrical signals as alpha- 
numeric characters using a barcode interpreting instruction set stored in the memory 50 and 
processed by the microprocessor 48. In this way, a unique survey element name, number 
or other alpha-numeric identifying feature is read from a barcode label 64 and 
communicated to the microprocessor 48. The microprocessor 48 may then search through 
the survey data stored on the memory module 30, or other interconnected memory device, 
to match the element identifying name of the barcode label with a particular survey data set 
and directly display the selected survey data in the manner shown in FIG 3A. 

This method speeds up the survey since an operator does not need to scroll through 
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images or image data to find the appropriate survey element and it reduces errors which 
may occur when a wrong data set is associated with a survey element. Moreover, the 
method of the present invention allows survey elements to be surveyed in any order 
without causing undue delay or errors. ^ 

5 The camera system 10 may be used to capture video images, store the images onto 

the memory module 30, recall the images and view the images on the display device 16. 
Furthermore, thermographic survey data, including images, relating to a survey element 
may be loaded and stored on the memory module 30 so that an operator may also view 
previously recorded infrared or visible wavelength images of a survey element on the 

10 display device 16 by scrolling through images using the keypad 14 to input conunands. 

Furthermore, data and images relating to a survey element includes a unique 
identifying name which is stored as a data field 3 10 with the survey element data. The 
camera 10 may be used to scan a barcode label 66 associated with the survey element to 
recall the appropriate survey element data set by matching the name on the barcode label 

15 with the unique identifying name associated with the survey element data. 

In another aspect of a preferred embodiment of the present invention, a master 
database program may be stored and operated on a base computer 80, shown in FIGS. 5A 
and 5B. The camera 10 or the memory module 30 may be interconnected with the base 
computer 80 before and after a thermographic survey is performed to transfer survey data 

20 to and from the camera 10 or memory module 30. In this case the base computer 80, 7n 
which may also be a portable or laptop computer and which may be taken to a survey sight 
by an operator, includes a digital data processor 82, an internal memory 84, a data storage 
device 86, a display device 88, a data entry keyboard 90, a mouse 104 and an I/O, terminal 
92 for interconnecting the base computer 80 with other devices. The base computer 80 

25 may also include a video processing module 94 for directly connecting with the camera 10 
and for receiving digital or analog image and other data from the camera 10 and for further 




processing image and other data using program instructions controlled by the processor 82 

The computer 80 preferably also includes a PCMCIA memory card slot 98 for 
receiving the memory card 30 therein, after removal from the camera 10, and a PCMCIA 
memory driver 100 for interfacing between the processor 82 and the memory module 30. 

5 Note that other memory slots and memory drivers may also be employed without deviating 
from the intended scope of the present invention. The base computer 80 may also include a 
barcode scanner 52 attached to the I/O port 92 and interfacing with the processor 82 so that 
bar-codes may also be scanned and stored in the memory 84. In addition, the base 
computer 80 includes a barcode printer 102 attached to the I/O port 92 and interfacing with 

10 the processor 82 so that bar-codes 66 may be printed onto a barcode label 64. 

The base computer 80 includes a number of programs stored in the memory 84 or 
in the storage device 86 and operating to control the computer system 80 and to interface 
with the camera 10, the keyboard 90, the display device 88, the barcode scanner 52, the 
barcode printer 102 and any other device which may be interconnected therewith through 

15 the I/O ports 92 or otherwise. These programs may include an operating system, e.g. 
Windows 95 or NT, MAC OS, UNIX, or the like, as well as application programs and 
interface drivers. In addition a standard or customized database application program 
specifically configured for storing and organizing thermographic survey data is also 
preferably installed on the base computer 80 and operated by the processor 82. 

20 The database program may include a number of data display layouts, e.g. 200 and 

300 illustrated in FIGS. 6A and 6B. The display layouts 200 and 300 provide a graphical 
user interface to the database program so that an operator may view, organize, edit, search 
or create reports based on thermographic survey data- Moreover, an operator can add or 
delete survey elements to a survey, create a new survey, create or edit a survey schedule, 

25 create an archive file or perform digital processing on survey element image files to further 
analyze the survey data. 
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The display layouts 200 and 300 shown in HGS 6A and 6B as might be displayed 
on the display device 88 include a tool menus 202 for displaying various pull down menus 
which can be selected by an operator using the keyboard 90 or mouse 104. A directory and 
file window 204 displays directories and files by name for ease of organizing 
5 thermographic survey data into groups or directories. A survey group directory 206 may 
include a plurality of thermographic surveys organized by survey directories 208 . Each 
survey directory 208 may include survey element records 210, 

Each element record 210 includes many data fields associated with a particular 
survey element and stored in the memory 84. The data fields which may be video clips, 
10 still video images, alpha-numeric or graphical fields, audio fields or fields which perform 
special functions such as calculations, automatic data entry or image processing are 
displayed on a display layout 200 or 300 in record windows, referred to generally by 
reference numeral 212. In HGS. 6A and 6B ^ record windows^include/a date and 



& time field 214. Image windows 216 display images of the survey element. The images 
T 15 may be either still or video clip images which may show an infrared image or a visible 
fill image of the survey element and which may be a reference image of the survey element or 
[* an image recorded during a recent survey. Other data fields may include element value 
:2 fields 218 which may include information about the survey element, e.g. the location of the 
element, tiie element manufacturer and installation date, serial numbers or other information 
20 as may be required by an operator to analyze the results of a survey. Another data field 
group includes camera fields 220 which include data relating to the conditions under which 
the image was recorded as well as trouble shooting steps, e.g. camera settings, survey 
element load and ambient environmental conditions at the time the survey image was 
recorded, survey schedules, problem causes, recommended actions and other data fields 
25 associated with capturing an image of the survey element. 

An element identifying field 222 is provided, on each display layout 200 and 300, 
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which uniquely identifies a survey element. The element identifying field 222 may 

comprise A an alphanumeric name or title of the survey element which may also be used to 
name the survey element record 210 so that the survey element is easily identified. In 
particular, in accordance with a preferred embodiment of the present invention, the element 
5 identifying field 222 is converted to a barcode using a barcode alpha-numeric conversion 
program, e.g. CODE 39, which is well known. In this case the application program CODE 
39 is loaded onto the base computer 80 such that if an element identifying field 222 is 
created or modified, a barcode 66 may be created by the CODE 39 program and saved in a 
separate database field. CODE 39 is a barcode application used in many industrial 
10 applications which converts a small subset of the ASCII characters set to a barcode symbol. 
Q In this case the upper case letters A through Z, the numbers 0 through 9 and the symbols 
W *$/+% plus a space may be converted to a barcode symbol. If an operator chooses an 
£0 element identifying name or if an older element identifying name includes lower case letters 
or other symbols not supported by CODE 39, the characters will be bar-coded by CODE 39 
~ 15 as follows. 

f 11 Promote all lower case letters to upper case. 

r Replace all characters that are not supported by CODE 39 with a period (.). 

^% Replace all spaces with a period (.), 

In addition, the * character is usually inserted at the beginning and end of a 
20 barcode. These steps may be done automatically by the barcode converting program or 
another program or by an operator or by an automatic entry feature of the database 
program. Consequently, a survey element named "Scrubber #7" would be converted to 
"♦SCRUBBER..?*" by CODE 39 prior to storing the converted element name in the 
barcode label field which will be used as the element identifying barcode 66. 
25 The barcode 66 may also be printed onto a label 64, e.g. having an adhesive 

backing, by the barcode printer 102. The thermographer may then take a barcode label 64 




to the survey element in the field and attach the label 66 to the survey element or onto an 
associated name plate or onto a surface near the survey element. Since the barcode 66 
uniquely identifies the survey element, the barcode scanner 52 attached to the camera 10 
may be used to scan the barcode label associated with the survey element such that the 
5 survey element is uniquely identified to the camera processor 48. The camera processor 48 
may then upload only the data needed for recording an image of the uniquely identified 
survey element from the memory module 30. In addition, the survey element image 
recorded by the camera 10 will be uniquely associated with the element identifying name of 
the barcode 66 scanned by the barcode scanner 52. 

10 

Thus the integrated infrared camera 10 of the present invention provides a mobile 
thermographic survey device capable of easy portability from one thermographic survey 
element to another without the need for a mobile cart or other cumbersome equipment. 
Moreover, the barcode label 64 associated with each survey element provides an identifying 
15 feature which when scanned by the bar code scanner 52 uniquely identifies the survey 
element to the video camera system so that a video image of the survey element will be 
stored in an appropriate memory field of the survey database. 

It will also be recognized by those skilled in the art that, while the invention has 
20 been described above in terms of preferred embodiments, it is not limited thereto. Various 
features and aspects of the above described invention may be used individually or jointly. 
Further, although the invention has been described in the context of its implementation in a 
particular environment, and for particular applications, e.g. an infrared sensor assembly 
and an infrared video camera system, those skilled in the art will recognize that its 
25 usefulness is not limited thereto and that the present invention can be beneficially utilized in 
any number of environments and implementations including but not limited to video 
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surveying and or archiving of art objects or other collectibles, for tracking video images of 
real estate properties, capital equipment, patient medical images or the like or in any other 
video image storage requirement wherein video images of elements are periodically 
updated. Accoixiingly, the claims set forth below should be construed in view of the full 
5 breadth and spirit of the invention as disclosed herein. 
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